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ABSTRACT 



To detect a watermark signal embedded within an informa- 
tion signal, predictive filtering is applied to either the 
information signal, a plurality of applied watermark signals, 
or both types of signals. After the filtering, a correlation is 
determined between the information signal and the water- 
mark signals. The amount of the correlation is indicative of 
whether a particular watermark is embedded within the 
information signal. 

8 Claims, 2 Drawing Sheets 
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DETECTING A WATERMARK EMBEDDED 
IN AN INFORMATION SIGNAL 

FIELD OF THE INVENTION 

The invention relates to the field of digital data processing 
and more specifically to detecting messages embedded in 
multimedia signals that are not detectable by the audience of 
such signals. 

BACKGROUND OF THE INVENTION 

The invention relates to a method of detecting a water- 
mark embedded in an information signal, comprising a 
correlation step for correlating said signal and an applied 
watermark, and an evaluation step for evaluating the result 
of said correlation. The invention also relates to a method for 
carrying out said method. 

Watermarks are perceptually invisible messages embed- 
ded in multimedia content such as audio, still images, 
animations or video. They comprise information, for 
example, about the source or copy right status of documents 
or audiovisual programs. Watermarks can be used to provide 
legal proof of the owner of the copyright. They allow tracing 
of piracy and support the protection of intellectual property. 

A known method of detecting a watermark embedded in 
an information signal comprises a correlation step for cor- 
relating said signal and an applied watermark. The result of 
said correlation is then evaluated. For example, if the 
amount of correlation is larger than a predetermined value, 
the applied watermark may be considered to be the water- 
mark embedded in the signal. Alternatively, a number of 
successive correlation steps can be carried out for different 
applied watermarks. The applied watermark yielding the 
largest correlation is then considered to be the watermark 
embedded in the signal. The above citations are hereby 
incorporated in whole by reference. 

SUMMARY OF THE INVENTION 

It is an object of the invention, to provide a method with 
which an embedded watermark can yet more reliably be 
detected. 

To that end, the method is characterized by the steps of 
predictive filtering the information signal or the applied 
watermark or both, and applying the correlation step to said 
filtered signal and said filtered watermark. 

The invention is based on the recognition that the problem 
of detecting watermarks closely resembles the detection of 
weak radio or radar signals in the presence of strong 
interference or noise. By predictive filtering, i.e. subtracting 
a prediction of the information signal from said signal, a 
residual signal is obtained having a significant lower vari- 
ance. This means that the interference which the watermark 
suffers from the residual information is considerably less 
than it suffers from the original signal. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 shows schematically an arrangement for water- 
marking a video signal. 

FIG. 2 shows schematically a prior art arrangement for 
detecting a watermark embedded in the signal which is 
generated by the arrangement shown in FIG. 1. 

FIG. 3 shows schematically an arrangement for detecting 
the watermark in accordance with the invention. 

FIG. 4 shows schematically further an arrangement for 
detecting the embedded watenmark in accordance with the 
invention. 



DETAILED DESCRIPTION OF THE 
PREFFERED EMBODIMENT 

The invention will herein be described by way of an 
5 example of detecting a watermark which is embedded in a 
digital video signal. The watermarks can be added in almost 
every domain such as, for example, the time domain, the 
spatial domain, the transform domain after DCT or Fourier 
transform, etc. In the present example, it is embedded in the 
spatial domain, i.e. it is added to the luminance pixel values 
of a digital video signal. 

FIG. 1 shows schematically an arrangement 1 for water- 
marking the video signal. The arrangement receives a video 
signal in the form of luminance samples or pixels p(n) and 

15 a watermark W^. The watermark can be a code which 
uniquely identifies the owner of the copyright. It can also be 
a text string or simply a binary coded number. Accordingly, 
there is a finite set of different watermarks W^.. Tlie arrange- 
ment comprises a watermark data signal generator 11 which 

20 generates a predetermined watermark data signal w,-(n) for 
each watermark W^-. The luminance value p(n) and water- 
mark data value w,{n) are added by an adder 12 pixel-by- 
pixel. Accordingly, the output signal xXn) of the watermark- 
ing circuit 1 is: 

25 

x^nyp («)+w,(n) 

The watermark data signal w,{n) is chosen such that it is 
perceptually invisible when the output signal is displayed on 

3Q a receiver. For example, a small value is added to the 
luminance of selected pixels p(n) of the video image, the 
watermark W,- determining the selected pixels. An example 
hereof will now be given in terms of an image of 8 pixels 
horizontally and 4 pixels vertically. It is to be noted that the 

3 J method can also be applied to a predetermined part of the 
image. The method can also be applied to a plurality of 
image blocks, each block being associated with a portion of 
the watermark. 

In the present example, the value 1 is added to the 
luminance of selected pixels whereas other pixels remain 
unaffected. The following equation denotes a watermark 
data signal Wi(n) that is generated by watermark data signal 
generator 11 in response to a first watermark W^: 



45 



0 10 10 10 1 

1 0 1 0 1 0 1 0 

0 10 10 10 1 

1 0 1 0 1 0 I 0 



50 



The following equation denotes a watermark data signal 
W2(n) that is generated by the watermark data signal gen- 
erator if a second watermark W^ is applied: 



55 



(SO 



0 0 1 1 0 0 11 

1 1 0 0 1 1 0 0 
0 0 1 1 0 0 11 
110 0 110 0 



In this manner, the watermark data signal generator U 
generates a different watermark data signal w,.(n) for each 
watermark W^.. 

In the present example, the video image is assumed to 
65 represent a vertical transition from a luminance value 10 to 
a luminance value 80. The range of luminance values p(n) is 
assumed to be 0-255. In mathematical notation: 
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Xi(n) and Wi(n) appears to be C(l,l)«736 whereas the 
10 10 10 10 80 80 80 80 correlation between Xi(n) and w^Cn) appears to be C(l,2)« 

10 10 10 10 80 80 80 80 7 28. Because C(l,l) is greater than C(l,2), the evaluation 

10 10 10 10 80 80 80 80 circuit 24 determines that the embedded watermark is W^. If 

10 10 10 10 80 80 80 80 ^ watermark is embedded, the correlation between XjCn) 

and w^(n) appears to be C(2,l)=728 whereas the correlation 
between X2(n) and W2(n) appears to be C(2,2)=736. Because 
Accordingly if watermark Wi IS applied to arrangement ^(2,2) is greater than C(2,l), the evaluation circuit 24 
1, the watermark data Signal w,(n) IS added to mfiage Signal j ; - * *l „u jj j . i - ^u tv i 
I ^ L- L w • *u f 11 • * * ■ 1 / \ determmes that the embedded watermark is W,. Tne fol- 

p(n), which results in the following output signal Xi(a): 10,.™..,, ■ u i* e 

^ r o / lowing Table 1 summanzes the above results. The rows of 

this Table denote input signal x^n), i.e. the input signal in 
which a watermark W,. is embedded. The columns denote 



10 11 10 11 80 81 80 81 



11 10 11 10 81 80 81 80 , „7 ... u ■ 

^i(«)=^Q go go gj watermark W,. which is appUed to arrangement 2. 



10 11 10 81 80 81 80 15 



Similarly, if watermark W2 is applied to the watermarking 
arrangement, the watermark data signal W2(n) is added to 
image signal p(n), which results in the following output 
signal xjn): 

10 10 11 11 80 80 81 81 



TABLE I 















C(l,l) » 736 


C(l,2) = 728 


20 




C(2,l) « 728 


C(2,2) = 736 



It will be appreciated from this example that the values of 
C(iJ) representing the amounts of correlation are close to 



11 11 10 10 81 81 80 80 u Tn.- * *u J 1 

jc2fn)= each other. This means that the detection circuit is vulner- 



10 10 11 11 80 80 81 81 25 

11 11 10 10 81 81 80 80 



able with respect to noise, Uransmission errors, coding errors, 
etc. 

FIG. 3 shows schematically an arrangement for detecting 

It will be appreciated that neither the difference between an the watermark W- embedded in the signal x^n) in accor- 

output signal x,<n) and input signal p(n), nor the difference dance with the invention. The arrangement comprises the 

between output signals x,(n) and x^(n\ is perceivable for a s^me watermark data signal generator 21. multiplier 22, 

human visual system. The output signal x,<n) is stored on a summation circuit 23 and evaluation circuit 24 as are shown 

storage mediunj such as an optical disc or a magnetic tape, 2. The arrangement further comprises a first predic- 

onransmitted through a transmission channel (not shown in ^^^^^ ^5 and a second predictive filter 26. The first 

■^^'^ . u n * f J * . 35 predictive filter 25 is connected between the signal input and 

FIG. 2 shows schematically a an arrangement for detect- . ^ . , /\ 

ing the watermark W, embedded in the signal x/n) that does "^"i^'^' f f signal x^n) and gener- 

not utilize the invention herein. The arrangement receives a ^J^^ ^ ^ ^ej^^ input signal x,(n). The pre filtcnng process is 

watermark W^- and delivers an indication of whether or not ^^^"^^ whitening , sunilar to filters that decorrelate 

the applied watermark W^- resembles the embedded water- "o*^ ^^^^^ ^nd radio communication receivers, 

mark W^., i.e. whether i=j or not. '^The arrangement comprises 40 The second predictive filter 26 is connected between the 

a watermark data signal generator 21 which is identical to, watermark data signal generator 21 and the multiplier 22. It 

and produces the same watermark data signal Wy(n) as the filters the locally applied watermark data signal w^(n) and 

watermark data signal generator 11 which is shown in FIG. generates a filtered watermark data signal Wy'(n). The struc- 

1. The input signal x/n) and the watermark data signal w/n) i^re of each predictive filter is based on statistical properties 

are applied to a circuit which is often referred to as a 45 of the information signal. Such filters are known perse in the 

matched filter or correlator. In the embodiment shown in field of source coding. Examples are linear predictive filters 

FIG. 2, said correlator comprLses a multiplier 22 and a as used in D PCM image and speech coding. Other examples 

summation circuit 23. The correlator performs the following are combinations of a transform, a prediction for each 

mathematical operation: frequency subband or transform coefficient, and an inverse 

' 50 transform. 

^. , , , , In the present example, in which the input signal is a 

^ ■ digital video image, predictive filter 25 predicts each pixel 
from its neighbors to the left, to the right, above and below. 
The predictive value is then subtracted from the actual pixel 

in which N denotes the total number of pixels. It will be 55 value to obtain a residual value. In mathematical notation: 
appreciated that, if the information signal is an analog 

signal, for example a lime continuous signal x(t), the sum- - 1. v) + y(u + 1, v) + y(«, v - 1) + >(«. v + 1) 

mation circuit 23 will be an integrator. >^("' ^) = ■ ' — — ■ — •■ ' 

The correlator output is a number C(i,j) which represents 
an amount of correlation between the input signal x,-(n) and 60 

the watermark data signal Wy(n). In an evaluation circuit 24, in which u and v denote discrete pixel positions along the 

the value C(i,j) is evaluated for various watermarks Wy. The horizontal (u) and vertical (v) axes, y(u,v) denotes filter 

watermark yielding the highest correlation is then input samples and y'(u,v) denotes filter output samples, 

assumed to be the watermark W,-. Only two different water- Accordingly, the following equations supply to the filtered 

marks are considered here. 65 input signal Xi'(n) and the filtered input signal X2'(n), respec- 

The correlation C(ij) can easily be calculated. If water- lively (a scaling factor 4 has been applied to maintain integer 

mark W, is embedded in the signal, the correlation between values): 
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18 14 7 
14 -4 4 
7 4-4 
24 7 14 



-56 147 84 77 164 

-74 74 -4 4 77 

_66 66 4 -4 84 

-63 154 77 84 158 



signal w^'(n), i.e. if the watermark data signal w^(n) is 
subjected to predictive filtering only. The input signal x^.(n) 
is directly applied to the multiplier 22 in this case. Again, the 
performance is worse than in Table II but still better than in 
Table I. 

TABLE IV 



4(/i) = 



19 


8 13 


-57 


148 


78 


83 


163 






W, 




13 


3 -3 


-73 


73 


3 


-3 


78 


10 


x,(n) 


C(l,l) - 604 


C(l,2) = 544 


8 


-3 3 


-67 


67 


-3 


3 


83 




X2(n) 


C(2,l) « 544 


C(2,2) - 588 



23 13 8 -62 153 83 78 159 



Further, the first predictive filter 25 and the second 
predictive filter 26 are the same in this example. Although 
this is a preferred embodiment which yields the best 
performance, it is not essential . The filters may be different, 
or one of the predictive filters 25 and 26 may even be 
dispensed with. The performance of the watermark detecting 
arrangement is then still significantly better than the perfor- 
mance of the prior art arrangement. Accordingly, the fol- 
lowing equations apply to the filtered watermark data signal 
Wi'(n) and the filtered waterniark data signal Wj^n), respec- 
tively: 



25 



-2 4 
4 -4 



-3 4 -3 
4-4 4 



4 -4 
-3 4 



4 -4 
-3 4 



4-3 4 

-4 4 -3 

4-4 4 

-3 4 -2 



-1 -2 3 3 -2 -2 3 3 . 

3 3 -3 -3 3 3 -3 -2 

-2 -3 3 3 -3 -3 3 3 

3 3 -2 -2 3 3 -2 -1 



The following Table II shows the amounts of correlation 
C(i,j) between filtered input signal x/(n) and filtered water- 
mark data signal Wy'(n) corresponding with watermark W^.. It 
will be appreciated from comparison with Table I that the 
performance of the watermark detector shown in FIG. 3 is 
significantly better than the one shown in FIG. 2. 



TABLE II 








Xi*(n) 


C(l,l) - 1152 


C(l,2) - 704 


X2'(n) 


C(2,l) - 704 


C(2,2) - 952 



Table III shows the amounts of correlation between fil- 
tered input signal x/(n) and the unfiltered watermark data 
signal w^{n), i.e. if the input signal x,{n) is subjected to 
predictive filtering only. The watennark data signal Wy(n) is 
directly applied to the multiplier 22 in this case. As can be 
seen, the performance is worse than in Table 11 but still better 
than in Table L 





TABLE III 




60 




w, 






Xi'(n) 


C(l.l) - 604 


C(l,2) = 544 




X2'(n) 


C(2,l) - 544 


C(2,2) - 588 





Table IV shows the amounts of correlation between the 
unfiltered input signal x,{n) and the filtered watermark data 



FIG. 4 shows a further embodiment of an arrangement for 
detecting the embedded watermark. In this arrangement, 
15 pre -filter circuit 41 conditions the information input. Then 
each pixel of the input signal x/n) is multiplied in a 
multiplier 42 by a specific weighting factor. The products are 
sumnied up in a summation circuit 43 which delivers the 
correlation value C(i,j). A calculating circuit 44 receives the 
20 applied watermark and generates the weighting factors 
using a model of the statistical properties of the information 
signal. In this embodiment, predictive filtering is not applied 
to the watermark input signal but embedded in the calcula- 
tion circuit 44. 

In summary, a watermark embedded in an information 
signal is detected by correlating said information signal with 
a plurality of watermarks W^{n). TTie respective amoimts of 
correlation C(i,j) are then evaluated to determine the water- 
mark embedded in the signal x^^n). The invention provides 
a significant improvement of the detection by predictive 
fihering (25) the information signal and/or predictive filter- 
ing (26) the applied watermark prior to the process of 
correlating the signals. The invention has been disclosed 
with reference to specific preferred embodiments, to enable 
those skilled in the art to make and use the invention, and to 
35 describe the best mode contemplated for carrying out the 
invention. Those skilled in the art may modify or add to 
these embodiments or provide other embodiments without 
departing from the spirit of the invention. Thus, the scope of 
the invention is only limited by the following claims: 
4Q I claim: 

1. A method of detecting a watermark signal embedded in 
an information signal, comprising the steps of: 

providing an applied watermark signal: 
predictive filtering of the information signal or the applied 
45 watermark signal or both; correlating the information 
signal and the applied watermark signal; and 
evaluating the result of said correlation. 

2. The method of claim 1, wherein the predictive filtering 
is adapted to predetermined statistical properties of the 
information signal. 

3. The method of claim 1, wherein both the information 
signal and applied watermark signal are predictive filtered 
and the predictive filter steps are the same. 

4. A method of detecting a watermark embedded in an 
information signal, comprising the steps of: 

filtering the information signal using filter coefiBcients 
determined by an applied watermark signal, and by a 
model of the statistical properties of the information 
signal: 

and evaluating the result of said filtering. 

5. An arrangement for detecting a watermark signal 
embedded in an information signal, comprising: 

conelation means for correlating the information signal 

and an applied watermark signal and: 
evaluation means for evaluating the result of said 
correlation, communicating with the correlation means; 
and 



50 



55 



65 
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a predictive filter for filtering the information signal or for 
filtering the applied watermarfc, or both, and connected 
for applying the filtered signal and the filtered water- 
mark to the correlation means. 

6. The arrangement of claim 5, wherein the predictive 5 
filter includes means to filter depending on predetermined 
statistical properties of the information signal. 

7. The arrangement of claim 5, wherein the predictive 
filter includes a first predictive filter for filtering the infor- 
mation signal and a second predictive filter for filtering the lo 
applied water mark and both predictive filters are identical. 



798 

8 

8. An arraiigement for detecting a watermark signal 
embedded in an information signal, comprising: 

a filter for filtering said information signal using filter 
coefficients: 

calculation means for calculating said filter coefficients in 
dependence on an applied watermark and a model of 
the statistical properties of the information signal; and 

means for evaluating the result of said filtering. 
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